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OPTIMUM ALLOCATION OF REDUNDANCY AMONG SUBSYSTEMS 


CONNECTED IN SERIES* 
by Dari D. Bien 
Lewis Research Center** 

SUMMARY 

This analysis considers the optimum allocation of redundancy in a system of serially 
connected k-out-of-n subsystems. The two problems treated are (1) maximization of 
system reliability subject to multiple cost constraints and (2) minimization of some 
function of multiple costs subject to maintenance of a minimum acceptable level of sys- 
tem reliability. These are problems for which there are no general solutions. It is 
shown herein that several techniques applied previously to analysis of the special case of 
series-parallel system optimization can, with certain adjustments and under certain con- 
ditions, be used to optimize redundancy in the series-k-out-of-n system. The tech- 
niques used to solve these problems are (1) dynamic programming, (2) generalized 
Lagrange multipliers, (3) sensitivity analysis, (4) multidimensional knapsack formula- 
tion with a branch -and -bound procedure , and (5) a synthesis of concave and integer pro- 
gramming. None of the methods is new but the applications to the series-k-out-of-n 
problems are unique. Some of the methods produce only approximate solutions, while 
others produce exact solutions with increased effort. Some are particularly suited to the 
determination of optimum redundancy for a single specification; others, because of their 
sequential natures, are more suitable for determining a range or family of optimal so- 
lutions. The procedures are discussed and compared; an example problem is solved by 
using three of the techniques. The special case of redundancy optimization under a single 
constraint for the series -parallel system is treated with the derivation by Lagrange mul- 
tipliers of approximate equations. These equations are shown to be useful in rapidly de- 
termining the approximate optimal allocation of redundancy in the series-parallel sys- 
tem. An example problem is solved by using these equations, and the results are com- 
pared with optimal solutions produced by a method of exact optimization. 

♦The material in this report was submitted as a thesis in partial fulfillment of the 
requirements for the degree Doctor of Philosophy in Statistics at Case Western Reserve 
University, Cleveland, Ohio, in September 1970. 

♦♦The author is now at the University of Denver. 



INTRODUCTION 


There is a basic conflict in utilizing redundancy in a system. The addition of re- 
dundant components increases the costs - measured in weight, volume, area, etc. - at 
the same time that it increases reliability. This conflict cannot be circumvented, but it 
can be minimized through optimum design. 

The conflict between quality and the outlay of resources is everywhere present. It 
is prominent, for example, in the design of complex electronic equipment for military or 
space use. Often there are constraints on some of the resources. In the case of space 
systems, the payload weight is limited by the capability of the launch vehicle. There are 
also often minimum acceptable reliability requirements, as in the case of manned space 
flight. 

The simplest redundancy arrangement is one where n components are connected in 
parallel and where the required function is performed as long as at least one of the com- 
ponents functions properly. If all components are identical and equally susceptible to 
failure during the entire mission, the arrangement is called parallel redundancy. It is 
for this case that most of the redundancy optimization procedures have been developed. 

A more general redundancy arrangement is one which requires at least k of n 
components to function properly. This is called k-out-of-n redundancy (ref. 1). As be- 
fore, all components are identical and equally susceptible to failure during the entire 
mission. The n identical components have a single function to perform and, taken to- 
gether, they are called a subsystem. A system generally requires the performance of 
several functions. This is accomplished by serially connecting a number of subsystems. 
Hence, the system under consideration is called a series-k-out-of-n system. 

In practice many subsystems are in modular form and the work load of the subsys- 
tem is distributed uniformly over k components. This is the case, for example, in a 
waste-heat rejection subsystem constructed of n identical modules, any k of which 
can reject the required amount of heat. Subsystem success is achieved by k or more 
successfully operating modules; failure occurs as soon as n - k + 1 modules have 
failed. It is noted that parallel redundancy is the special case where k = 1; a purely 
series subsystem is the special case where k = n. 

The problem of optimally allocating redundancy in the series-k-out-of-n system is 
treated herein. Study of this problem was motivated because (1) k-out-of-n subsystems 
are important by themselves and (2) k-out-of-n subsystems include as special cases the 
parallel and series subsystems. 

The object of this analysis is to formulate methods for optimally allocating redun- 
dancy in series-k-out-of-n systems. The techniques are not new; they have been applied 
previously to a special case, namely, the case of series-parallel systems - systems 
composed of serially connected subsystems where only one component in each subsystem 
is required to survive. 
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The conditions under which these techniques can be used for the more general 
series-k-out-of-n system are developed. The methods are compared for effectiveness 
and utility. 

Finally, the special series-parallel system is treated. Closed-form equations are 
available in the literature, and they are compared with equations derived herein by the 
method of Lagrange multipliers. 


PROBLEMS TO BE TREATED 
General Redundancy Allocation Problems 

The technique of using redundancy in an optimal way to increase the reliability of a 
system is the subject of this analysis. Redundancy involves the inclusion of more com- 
ponents than necessary to perform a given function. These additional components allow 
for some component failures without causing the system to fail. 

Reliability is the probability that a component, subsystem, or system will operate 
satisfactorily for a specified period of time. For reliability analysis, any complex sys- 
tem may be represented as m serially connected subsystems. 

The reliability of the i subsystem is r. For m subsystems connected in ser- 
ies, the product rule gives the system reliability as 


R = 



(1) 


and thus the system reliability is less than the reliability of the least reliable subsys- 
tem. Associated with each component of subsystem i, there are s different costs, 
such as weight, area, volume, money, etc. Since there are n. components in the i^ 1 
subsystem, the total system cost of the j type is 


m 


; -rZ 


i=l 


c ij n i 


j = 1, • • • , s; n A integer 


( 2 ) 


th th 

where c^ is the j type cost of a single component of the i subsystem and is as- 
sumed to be positive and where the • subscript denotes summation over i = 1, — ,m. 

A problem of interest is to maximize the system reliability R without exceeding 
any of s cost constraints. If C . max is the allowable use of resource j, this prob- 
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lem can be stated symbolically as follows: 


Problem I: Maximize the total system reliability 


m 



1= 


( 3 ) 


subject to 


m 

Z°ij n i SC -i,max j = 1 S; nj integer (4) 

i=l 

A related problem is to minimize some function of the cost factors C. ^ (j * 1, . . . , s) 
without allowing the system reliability to drop below an acceptable level. If R m ^ n is 
the minimum allowable system reliability, the problem can be stated symbolically as 
follows: 

Problem II: Minimize some function of the s cost factors 

m 

C -j = X C ij n i j = !»■•• > s ; n. integer (5) 

i=l 

subject to 

m 

FT r. > R . (6) 

I I l min 
i=l 

Often the designer is not simply interested in the one solution which satisfies the 
constraints of problems I and II. Rather he may be interested in relaxing the constraints 
and generating a family of optimum solutions for a range of constraint values. In prob- 
lem I terminology, several values of C, . (j = 1, . . . , s) are to be selected and, for 

J y IllctX 

each, a solution having maximum R is of interest. In problem II terminology, several 
values of R min are to be selected and, for each, some minimum cost function is to be 
generated. Problems I and II describe the same points in RC . space. That is, the 
redundancy allocation which yields a maximum R in problem I equal to R . of prob- 
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lem II is the same allocation which produces a minimum C . in problem II equal to 
C . of problem I. Therefore, problems I and II can be treated simultaneously by 

* J y H13X 

generating a family of undominated allocations. Undominated allocations are defined in 
the next main section. 


Subsystems of k-out-of-n Type 

The series-k-out-of-n system is of particular interest because of its general form 
and also because it has several direct applications. A vapor chamber radiator for space 
application is one of the subsystems of the spacecraft which must operate successfully 
in order to have mission success. It consists of several hundred (n) independent cham- 
bers of which some number (k) must function in order to reject the required waste heat 
from a powerplant (ref. 2). 

Another example is a panel of solar cells used to supply electricity. Such a panel 
generally consists of hundreds or thousands (n) of independent cells, each capable of 
supplying some small quantity of electrical power. As long as some number (k) of these 
cells operate successfully, the solar cell subsystem supplies the required power. But, 
when n - k + 1 of the cells have failed, the electrical subsystem has failed and the sys- 
tem fails. 

This analysis deals only with active redundancy; that is, all n of the components 
are in the "on” position and vulnerable to failure during the entire mission. Such re- 
dundancy is quite common in complex remote systems, such as space applications, 
where all components are subjected to a hazardous environment. The standby redun- 
dancy case, where redundant components are switched on only when the active compo- 
nents fail, is not treated herein. It is more complex in that it requires additional 
sensing and switching devices and these devices affect the system reliability. 

A further justification for active redundancy is found in much of the present design 
philosophy for complex systems. Redundancy is usually costly; because of this, many 
systems are designed to begin a mission by utilizing all.available system capability. 

As failures occur, the performance is degraded, but vital functions of the system can 
still be performed. System failure occurs when the performance of the system falls 
below acceptable levels. In the case of space systems, this acceptable system per- 
formance might logically be survival of the crew in manned missions or performance 
of key experiments in unmanned missions. In such cases, system reliability is the 
probability of performing some basic vital functions for the duration of the mission. 

It is assumed that the reliability of any component is independent of the state of the 
other components. All components within a given subsystem are identical. Since the 
concern here is with end -of -mission success and it is presumed that each designer 
specifies his required mission time, the individual component success probability is 
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treated as an assigned constant p^. That is, time dependency would likely play a part 
in the determination of p^, but for the purposes of this analysis p^ is just another 
specified constant. If the component failure probability is q^ = 1 - p. , the subsystem 
reliability is given by the binomial summation as 


r. 


n. 

1 


x=k i 



i= l,...,m; kj.n. integer 


(7) 


Another form of this equation, which is sometimes less cumbersome for computational 
purposes, is the negative binomial 



i = 1 , . . . , m ; k . , n. integer 


( 8 ) 


A typical series-k-out-of-n system is shown in figure 1. 

In principle, the optimum allocation of redundancy can be achieved by examining all 
possible combinations of components and choosing the ones which satisfy the require- 
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ments of reliability or costs. This, however, involves an inordinate expenditure of 
effort. Several methods have been used to obtain solutions for the series-parallel sys- 
tem without searching all combinations. Five of these methods have been adapted to the 
problem of series-k-out-of-n systems, and these solutions are presented in the next 
main section. 

The first method is that devised by Kettelle (ref. 3) and was modified by Proschan 
and Bray (ref. 4) to include multiple cost factors. Their work, of course, is for the 
series-parallel system. Kettelle's modified method is used to generate the complete 
family of solutions over a range of reliability and costs; but since it is a dynamic pro- 
gramming technique, it is plagued by the problem of dimensionality. The second method 
uses Lagrange multipliers as applied to nondifferentiable functions (ref. 5) to generate 
the "best" solutions with much less effort than required by Kettelle's method. The 
third method involves selecting consecutively for redundancy the subsystem which con- 
tributes the greatest reliability per unit of weighted costs (ref. 1). By generating solu- 
tions for a grid of weighting factors, this method gives the same solutions as the 
Lagrange multiplier method. These last two methods are subject to some restrictions 
on the subsystem reliability equation, which are discussed herein. An example prob- 
lem is worked using all three techniques and comparisons are made. 

Two other methods for treating problem I, the maximization of reliability subject 
to several cost constraints, are presented. Ghare and Taylor (ref. 6) use a multi- 
dimensional knapsack formulation of the series-parallel system optimization problem. 
Using a branch -and -bound procedure, they obtain the exact solution to problem I. It is 
shown in the following main section of this report that their procedure is also valid for 
the series-k-out-of-n system. The final method of solving this problem is that of 

'l l 

Mizukami' (ref. 7). His method for maximizing concave functions is referred to as the 
method of concave and integer programming. The reliability function which is to be 
maximized is made approximately piecewise linear in reference 7. Methods of linear 
programming can thus be used to obtain approximate solutions to this problem. Some 
discussion is included herein concerning the advantages and disadvantages of all five 
techniques. 


Subsystems of 1-out-of-n Type 

The series-parallel system is of interest because many systems require the per- 
formance of m functions where each function can be performed by only one component. 
A subsystem then consists of n components, only one of which needs to survive for sub- 
system success. 

The section SERIES-PARALLEL SYSTEM presents the derivation of two 
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closed-form equations for the approximate optimum distribution of redundancy under the 
models of problems I and II when there is only a single type of cost. The derivation of 
both equations is by the method of Lagrange multipliers. 

Only one of the equations is new, however. The equation derived herein for solving 
problem I is the same as that derived by Mine (ref. 8) using calculus of variations and 
by Federowicz and Mazumdar (ref. 9) using geometric programming. The equation de- 
rived herein for solving problem II differs slightly from those derived by Moskowitz and 
McLean (ref. 10) using a variational technique and by Kulakov and Zagoruyko (ref. 11) 
using sensitivity balancing. This new equation is to be compared with those cited from 
the literature. 

The reason for inclusion of the section on the series-parallel system is, for the 
first time, to present solutions for both problems I and II in closed form and derived by 
the same method. A comparison is made of the three solution equations to problem II. 

It is assumed, as with the k-out-of-n subsystem, that the reliability of any compo- 
nent is independent of the state of the other components. Each component within a given 
subsystem has success probability p^ and a single type of cost c^. If the component 
failure probability is q^ = 1 - p^, the subsystem reliability is given by 

r. = 1 - q. 1 i = 1 , . . . , m (9) 

Since only a single type of cost is used in the analysis of series-parallel systems, the 
total cost in equation (2) is just 


C = 


n 


E 


Vi 


( 10 ) 


Likewise, the models of problems I and II must be modified in that the constraint of 
equation (4) becomes 


m 

E c.n. ^ C n. integer 

l i max i & 

i=l 

and the objective function of equation (5) becomes equation (10). 

A typical series-parallel system is shown in figure 2. 

The problem, as before, is to generate the optimum solutions to the redundancy 
allocation problem. Explicit equations are derived for the values of (i = 1, . . . ,m) 
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Figure 2. - Typical series-parallel system. Shading indicates redundant component. 


resulting in (1) the greatest reliability for a given cost constraint and (2) the least cost 
for a given reliability goal. An example problem is solved by use of these equations 
and comparisons are made with the exact integer solutions. 


REVIEW OF THE LITERATURE 

In an analysis of redundancy optimization, one is aided by varying disciplines, from 
reliability to optimization procedures. Although not all directly related to the problem 
of redundancy optimization, the references cited herein were of value in offering in- 
sights into the problem. 

A comprehensive discussion of redundancy optimization is found in Barlow and 
Proschan (ref. 1) . Chapter 6 of that reference is devoted to both active and standby 
1-out-of-n redundancy subject to single and multiple constraints. Kettelle (ref. 3) pro- 
vides a dynamic programming algorithm for obtaining the complete family of optimum 
integer solutions for the parallel redundancy case. He also derives an equation for 
maximum reliability as a function of cost, but this equation gives no indication of the 
magnitude of n. (i = 1 , . . . , m) . Proschan and Bray (ref. 4) extend Kettelle's algorithm 
to include multiple constraints. Dynamic programming is the subject of a book by 
Bellman (ref. 12). 

The parallel redundancy allocation problem is solved graphically by DiToro 
(ref. 13), Herron (ref. 14), van Hees and Meerendonk (ref. 15), Thakkar and Hughes 
(ref. 16), and Korman (ref. 17). Korman also discusses the standby redundancy prob- 
lem. 

Everett (ref. 5) discusses the method of Lagrange multipliers as applied to optimi- 
zation of nondifferentiable functions. He uses this to get some solutions for the single- 
constraint parallel redundancy case. Fox and Landi (ref. 18) and Zahl (ref. 19) present 
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a general study of constrained optimization problems. 

Kolesar (ref. 20) uses integer linear programming to maximize reliability subject 
to constraints for three parallel redundancy problems: (1) single type of failure, (2) two 
types of failure, and (3) failure to operate or premature operation. A good book on in- 
teger programming is that by Saaty (ref. 21). 

Alekseyev and Iakushev (ref. 22) and Alekseyev (ref. 23) use dynamic programming 
for the multiple -constraint parallel redundancy problem. Several restrictions on the 
problem result in a much smaller search area than by previous methods. Under these 
restrictions this method is efficient; otherwise, it is plagued by dimensionality. 

Bellman and Dreyfus (ref. 24) use dynamic programming to solve the two -constraint 
case for parallel redundancy. 

Sasaki (refs. 25 and 26) and Webster (ref. 27) develop a computational procedure 
for the case of multiple linear constraints. Tillman (ref. 28) and Tillman and 
Liittschwager (ref. 29) consider the optimal multiple linear and nonlinear separable con- 
straint solutions to both parallel and standby problems by the method of integer pro- 
gramming. Mizukami (ref. 7) maximizes reliability subject to multiple constraints by 
the methods of concave and integer programming for the parallel redundancy case. 

Ghare and Taylor (ref. 6) solve the same type of problem by a multidimensional knap- 
sack formulation using a branch-and -bound procedure. 

Standby redundancy is discussed by Geisler and Karr (ref. 30), Black and Proschan 
(ref. 31), Morrison (ref, 32), Morrison and David (ref. 33), and Subba Rao and 
Natarajan (ref. 34). The concepts of sensitivity are discussed by Thakkar and Hughes 
(ref. 16), Breipohl (ref. 35), Kulakov and Zagoruyko (ref. 11), and Isayev and 
Mamed-Zade (ref. 36). 

Several of the references present some approximate equations for the single- 
constraint parallel redundancy optimization problems. Federowicz and Mazumdar 
(ref. 9) use geometric programming and Mine (ref. 8) uses calculus of variations to 
obtain the optimum number of components as a function of cost. Moskowitz and McLean 
(ref. 10) use a variational technique and Kulakov and Zagoruyko (ref. 11) use sensitivity 
balancing to arrive at two different expressions for the optimum number of components 
as a function of reliability. 

Optimum arrangement of components based on several types of failures and without 
constraints is discussed by von Neumann (ref. 37); Moore and Shannon (refs. 38 and 39); 
Birnbaum (ref. 40); Hanne (ref. 41); Barlow, Hunter, and Proschan (ref. 42); and 
Gordon (ref. 43). Morrison (ref. 44) considers not only costs associated with the com- 
ponents but also cost of system failure and cost of component failure. 

Kondo (ref. 45) discusses a method of successive approximations for solving the 
nonlinear, parallel redundancy equations. Fan, Wang, Tillman, and Hwang (ref. 46) 
maximize by numerical methods the expected net profit of a system. Expected net profit 
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is the product of success probability and profit realized with successful operation, de- 
creased by the cost of the system. Neuner and Miller (ref. 47) develop an empirical 
curve fit for the reliability -resource tradeoff of complex systems whose reliability equa- 
tions may be difficult to derive. Beznosov, Zelentsov, and Romanov (ref. 48) realize 
the difficulty in trying to compare different schemes of redundancy, so they choose as a 
basis for comparison the mean time between failures and then compare parallel, stand- 
by, majority vote, and logic redundancy. 


SERIES-K-OUT-OF-N SYSTEM 

In this section, solutions to the redundancy allocation problem for serially connected 
k-out-of-n subsystems are considered. The special case (k = 1) of the series-parallel 
system problem has been solved in the literature by several methods. Five of these 
existing Techniques are adapted in this section to give solutions to the more general 
series-k-out-of-n problem. 

Kettelle's method (ref. 3) is an application of dynamic programming. It gives the 
complete family of optimal solutions but has the disadvantage of being rather lengthy in 
application. A second method uses Lagrange multipliers as applied to optimization of 
discrete and, hence, nondifferentiable functions. A third method constructs successively 
larger allocations by adding to the system the redundant component which provides 
greatest improvement in reliability per unit of weighted costs. These last two methods 
are used to generate incomplete families of optimal solutions; but generally, adjacent 
solutions are close enough to each other so that a good approximation to the true solu- 
tion can be obtained. 

The problem of maximizing reliability subject to several cost constraints is treated 
by Ghare and Taylor (ref. 6) by the multidimensional knapsack formulation with a 
branch-and -bound procedure. Their procedure gives the exact solution to the series- 
parallel redundancy problem, and it is shown herein that the method can also be used 
for series-k-out-of-n redundancy optimization. Finally, the concave and integer pro- 
gramming method of Mizukami (ref. 7) is shown herein to give an approximate solution 
to the problem under consideration. 

No new methods are developed in solving this problem. Rather it is shown that 
these existing techniques, proven applicable to the special case of series -parallel re- 
dundancy optimization problems, are applicable to the more general series-k-out-of-n 
problems under certain conditions which are specified. The relative merits of the five 
procedures are discussed. 
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Kettelle's Method 


Statement of the problem . - Kettelle (ref. 3) presents an algorithm for allocating 
redundancy in the series -parallel system so as to maximize system reliability without 
exceeding a specified single -cost constraint (or equivalently, to minimize a single type 
of cost while maintaining at least a minimum reliability level). Proschan and Bray 
(ref. 4) extend Kettelle's algorithm to the problem of several cost constraints. 

A system of m serially connected subsystems is specified. The system is opera- 

J.L. 

tional if and only if each subsystem is operational; the 1 n subsystem is operational if 
and only if at least k. of the n. components in that subsystem are operational 
(i = 1, . . . ,m). It is assumed that the system, subsystem, or component can exist in 
only two possible states: success or failure. The failure of one component has no effect 
on the failure of any other component. Suppose component i has a cost c.^ of the 
type, where i = 1, . . . ,m and j = 1, . . . , s. A linear constraint exists on each cost as 
given by equation (4) : 


m 

Z c ij n i- C .j,max j = 1 , . . . , s; n i integer ( 

i=l 

A component of subsystem i has probability Pj of successfully functioning, inde- 
pendent of the states of the other components in the system. For the k^out-of-m sub- 
system, the subsystem reliability is given by equation (7) as 



(7) 


System reliability is given by equation (1) as 


m 



i= 


By combining equations (1) and (7), the system reliability R(n), where n = (n. , . . . ,n ), 
is 


12 



R(n) 



( 12 ) 


Problem I is to choose n, a vector of positive integers, in such a way that R(n) is 
maximized subject to the constraints of equation (4). Conversely, one may be interested 
in minimizing the costs C ^(n), where j = 1, . . . , s, in such a way that the reliability is 
at least as great as R min > as shown in equation (6) of problem II. 

Dynamic programming approach . - The method developed by Kettelle (ref. 3) is a 
dynamic programming technique. Dynamic programming is a decomposition technique 
for solving multiple decision problems. The optimum redundancy problem fits this 
description because there are m decisions to be made concerning the optimum values 
of n^ (i = 1 , . . . , m) . The approach is to decompose the m -decision variable problem into 
m one -decision variable problems. These m subproblems are, in the optimum re- 
dundancy application, easier to solve than the original problem. This decomposition is 
attained in such a way that the optimal solutions to the subproblems yield the optimal 
solution to the original problem. This is assured by the principle of optimality of dy- 
namic programming of Bellman (ref. 12, p. 83) which says: 

An optimal policy (rule for decisions) 1 has the property that whatever 
the initial state and initial decisions are, the remaining decisions 
must constitute an optimal policy with regard to the state resulting 
from the first decision. 

This principle yields a useful recurrence relation, which follows after some prelim- 
inaries. 

Consider the sequence of m functions defined by 


f 

m 


(p ■ max) 


max 

T 

m 


m 

TT 


i=J 


(13) 


where C . max (C . i } max’ * ‘ ' s, max j, max > ® ^ lj 
T m is the set of n. values defined by the constraints of equation (4) . 


, s; m = 1,2, . . .); and 


1 


Contents of parentheses are not included in Bellman’s principle. 
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£ 


i=l 


c ij n i * C 


j, max 


j = 1, • • • ,s; n i integer 


(4) 


Since the constraints of equation (4) limit n^ in such a way that none of the costs is ex- 
ceeded, it is obvious that 


n. s mm 
i 


j=l 


• 3 , max 

C ij . 


i = 1, . . . ,m 


(14) 


where [y] denotes the greatest integer less than or equal to y. From equation (13) 
with m = 1, 


f l(^- max) 


max 


r l( n l 


(15) 


But to maximize r^n^), n^ should be chosen as large as possible because reliability 
increases monotonically as n^ increases. Putting the largest n^ satisfying equa- 
tion (14) into equation (15) yields 



(16) 


where again [y] denotes the greatest integer less than or equal to y. 

The principle of optimality of Bellman (ref. 12, p. 83) yields the recurrence 
relation 


f m(^- max) 


max<r (n )f « C 
„ i m v m' m-l\ • 


m 


• max " c m n m 


(17) 


n = (C , 

• m \ • 1, 

must be chosen subject to the constraints 


where C . max “ c m 


max " c ml n m’ ‘ ^ • s, max " c ms 


n m) 


and where n 


m 


k m ~ n m - min 

i=i 


3, max 


m] J 


n m integer 
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where [y] denotes the greatest integer less than or equal to y. The lower limit on n 
follows from the fact that there must be at least k m components in the m subsystem 
in order for it to perform its intended function; that is, it is a k m -out-of-n m subsystem. 

The recurrence relation of equation (17) allows uncoupling of the m-dimensional 
problem into subproblems. This is the principle of dynamic programming. 

The dynamic programming algorithm of Kettelle (ref. 3), as modified by Proschan 
and Bray (ref. 4), is used here to generate successive allocations until either the design 
level of system reliability is reached or one of the cost constraints is exceeded. Thus, 
this procedure readily lends itself to either of the two redundancy allocation problems 
of interest, that is, maximizing reliability without exceeding any of several cost con- 
straints or minimizing some function of the costs while achieving at least a minimum 
prescribed level of system reliability. Because of this, the procedure readily lends 
itself to applications where tradeoffs between reliability and costs are of interest. 

Undominated allocations . - Proschan and Bray (ref. 4) define dominating alloca- 
tions. Let C j(n) represent the amount of resource j utilized in redundancy alloca- 
tion n. Then n 1 is said to dominate if C .(n*) <C . (n 2 ) for all 1 = 1 .... s 

• J • J j > y 

while It(n*) > R(n 2 ). If, in addition, at least one of these inequalities is strict, n* 

dominates n strictly. No strictly dominated allocation is a part of the set of optimum 
allocations . 

The purpose of the dynamic programming procedure is to generate the complete 
family of undominated allocations, meaning those allocations which are not strictly 

_0 i 

dominated. The allocation n is undominated by n if any one of the following 
conditions is true: 

(1) R^ 1 ) ^ R(n 2 ), but at least one C .(n*) > C ^(n 2 ), where j = 1, . . . ,s. 

(2) All C .(n 1 ) < C .(n 2 ), where j = l,...,s, but R^^R^ 2 ). 

(3) All C ^ (n ■*■) = C ^(n 2 ), where j = 1, . . . ,s, and R^ 1 ) = R(n 2 ). 

Kettelle's procedure (ref. 3) constructs undominated allocations for successively 
larger groups of subsystems until the entire system is included. For a single subsys- 
tem, each possible allocation is an undominated allocation because, with the addition of 
each redundant component, r i increases and C-. (j = 1, . . . ,s) increases. The proce- 
dure consists of systematically eliminating all strictly dominated allocations, after 
which only undominated allocations are left. The final set of undominated allocations, 
satisfying the cost and/or reliability constraints, forms the complete family of solu- 
tions to the redundancy allocation problems. 

Kettelle's procedure used on an example problem . - The details of the dynamic 
programming algorithm are discussed by Kettelle (ref. 3) and Proschan and Bray (ref. 4) 
and are not repeated here. The algorithm consists of the pairwise combination of the 
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m subsystems in all possible ways. For a system 1 of m subsystems, there will, thus, 
be m - 1 pairings. Since each pairing is facilitated by a table, m - 1 tables will be 
generated in this procedure. 

J_L 

For the example problem, a system of four subsystems is specified. The 1 com- 
ponent has associated with it two cost characteristics, monetary cost c., and weight 
c^, as well as success probability p^. The i in subsystem requires at least com- 
ponents; additional components are redundant. 

Table I lists the component monetary cost, the component weight, the component 
success probability, and the minimum number of components required for subsystem 
success for each of the four subsystems. The system is illustrated in figure 3. 


TABLE I - PARAMETERS FOR EXAMPLE PROBLEM 


Parameter 

Subsystem 


1 

2 

3 

4 

Minimum number of components required, 

3 

2 

1 

4 

Component monetary cost, 

4 

5 

7 

3 

Component weight, c g 

1 

1 

1 

1 

Component success probability, p t 

0.6 

0 7 

0 9 

0 5 




Figure 3. - System of four k-out-of-n subsystems connected in series - example problem. 
Shading indicates redundant component 
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In addition, the formulation of problem II is specified for this example. It is de- 
sired to generate the complete family of undominated allocations having reliabilities 
from 0.90 to 0.95. It is important to specify precisely the lower limit on system relia- 
bility - in this case R min = 0.90 - because the procedure begins there and produces so- 
lutions having increasingly higher reliabilities. That is, the tables generated by this 
method of solution can be extended to higher reliabilities, but the whole problem may 
have to be reworked in order to get lower reliabilities. 

There is a multitude of different subsystem combinations which, when hooked to- 
gether in a system, would yield system reliability somewhere in the specified range - in 
this case, 0.90 to 0.95. Each of these unique systems could be characterized by the 
quantities R(n) and C^(n) (j = 1, . .. ,s). The steps of the procedure are outlined as 
applied to this problem. 

Step 1: Plan the successive combinations of subsystems which use subsystems 1 
and 2 together. Following this, combine subsystems 3 and 4 to generate the undominated 
allocations. For larger systems, continue this procedure until all subsystems have been 
combined. 

The next level of combinations uses the results of the first set of combinations. 

That is, the undominated allocations for subsystems 1 to 4 are generated by using the 
undominated allocations of subsystems 1 and 2 in conjunction with the undominated alloca- 
tions of subsystems 3 and 4. The combining stops when all subsystems have been in- 
cluded . 

The combinations used for the example problem of table I are illustrated in figure 4. 
The combinations selected are of equal size; that is, (1, 2) paired with (3, 4). This is 
not necessary, however, in that the same optimal allocations are obtained by using an 
alternate sequence shown in figure 5. But, according to Barlow and Proschan (ref. 1), 
the procedure is more "regular" if the combinations, as nearly as possible, contain an 
equal number of subsystems. Thus, the combinations of figure 4 are used here in 
preference to those of figure 5. 

Step 2: For each subsystem, determine the minimum number of components re- 
quired to achieve the least allowable system reliability (in this case, R min = 0.90) for 
that subsystem alone. The reasoning here is that any subsystem configuration which 
cannot, by itself, support the reliability R . will certainly not be a part of the system 


Subsystem Combinations, level 1 Combination, level 2 



Figure 4 - Combinations used for four-subsystem example problem 


Subsystem 

Combination, 

Combination, 

Combination, 

level 1 

level 2 

level 3 

1 1 

[ 1.2 

1 'I 


2 J 

1. 2 -3 | 


3 

J 

1 1 

1,2, 3, 4 

4 

— 




Figure 5. - Alternate combinations for four-subsystem problems. 
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whose reliability is the product of the subsystem reliabilities. Because of the product 
rule, the system reliability can never be greater than the reliability of the least reliable 
subsystem. 

These minimum requirements are obtained by determining the values of 
m (i = 1 , . . . , m) which satisfy 

r^m) > R min i = 1, ... ,m; n. integer (19) 

The resultant values of n^ (i = 1, . . . , m) are called the base requirements. Once the 
base requirements are established, the rest of the computation concentrates on addi- 
tional costs and additional reliability improvements above these base values. In other 
words, only configurations with reliability equal to or greater than R m ^ n will be con- 
sidered. 

Base requirements, subsystem monetary costs, subsystem weights, and subsystem 
reliabilities for the example problem, determined from equation (19) with R ^ = 0.90, 
are shown in table II . The total monetary cost of this basic system is 91 units, obtained 


TABLE II - BASIC REQUIREMENT AND ASSOCIATED COSTS AND 
RELIABILITIES FOR EXAMPLE PROBLEM DETERMINED 
FROM R mm = 0.90 



Subsystem i 

1 

2 

3 

4 

Number of components required, n 

7 

4 

1 

12 

Subsystem monetary cost, C ^ 

28 

20 

7 

36 

Subsystem weight, C^ 

7 

4 

1 

12 

Subsystem reliability, r 

0.903744 

0.916300 

0 900000 

0 927002 


from equation (2) with j = 1. When the same equation is used with j = 2, the total 
weight of the basic system is 24 units. The basic system reliability, obtained from 
equation (1), is 0.690886. 

Step 3: For the first pair of subsystems, generate table III. The row headings 
pertain to subsystem 1, beginning with the basic subsystem and adding one component at 
a time to get the successive blocks of row headings. The four row headings in each 
block are nj, = c^n^ C 12 = c i 2 n l ’ and r i( n i)- The column headings are the 
analogous quantities for subsystem 2, beginning with the basic subsystem and increas- 
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[Combinations are formed as follows: number of components required, n^, n 2 ; monetary cost, Cjj + C 21 ; weight, Cj 2 + C 22 ; reliability, rj x r 2 . Shading 
outlines eliminated areas, line connects undominated allocations (completely shaded blocks)!] 


o 
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0.997190 m 0 986286 0.993410 0.995904 







































































































ing 112 by one unit to obtain the next block of column headings; that is, the column 
headings in each block are ng, Cgp C 22 , and ^(ng). 

The question arises concerning the number of rows and columns needed. Provision 
should be left for extending the table if necessary, but successive headings should be 
posted until the subsystem reliability is large enough to support the largest system 
reliability of interest - in this case, 0.95. Because R is the product of the 
r . (i = 1 , . . . , m) , a good guess on how far to carry the row and column headings for 
table III is until r^ > R*' m ; in this case, until r^ > (0.95)*^ = 0.987259. In addi- 
tion, two additional rows and two additional columns are included in case later expan- 
sion of the table is needed. 

Step 4: To construct the set of undominated combinations for the first two subsys- 
tems, start by entering in table III the monetary cost, the weight, and the reliability of 
the combination of subsystems 1 and 2. For example, the monetary cost to be entered 
in the upper left block is the summation of the monetary cost of subsystem 1 with n^ = 7 
and the monetary cost of subsystem 2 with ng = 4. That is, the monetary cost to be 
entered is 28 + 20 = 48. Likewise, the weight of that block is 7 + 4 = 11. The relia- 
bility of the combination is the product r^rg = 0.828101. 

Since this combination does not meet the system reliability requirement of at least 
0.90, proceed to the next allocation by combining ^ = 8 with n 2 = 4. This results in 
a monetary cost of 52, a weight of 12, and a reliability of 0.870662. This process con- 
tinues in the direction of increasing reliability until a reliability of at least 0. 90 is 
reached. This occurs at the intersection of the second row and second column giving 
a monetary cost of 57, a weight of 13, and a reliability of 0. 920946. Thus, the alloca- 
tion (np = (8, 5) is the first undominated allocation which satisfies the reliability 
constraint. 

Often the entire remainder of a row or column is dominated and can be rejected 
from further consideration. If the reliability of a particular combination is at least as 
great as the reliability in the heading of a previous row, all entries in that previous row 
having monetary cost and weight at least as great as the present combination can be re- 
jected. The reason is that such dominated entries always have monetary costs and 
weights at least as great as the dominating allocation and their reliabilities are lower. 

For example, in table in, the reliability of combination (8, 5) is greater than the 
reliability in the block heading the first row and, hence, all entries in that row cost- 
ing 57 or more and weighing 13 or more can be rejected. 

An analogous argument holds for eliminating from consideration the remaining por- 
tion of a column. For example, in table m, the combination (8, 5) dominates anything 
in the first column costing 57 or more and weighing 13 or more. Shading is used in 
table III to outline the remainders of rows and columns which are eliminated from 
consideration by this means. 

From this first undominated allocation (8,5) which satisfies the reliability con- 
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straint, other entries are posted only as needed, that is, until the reliability of the com- 
bination is able to support the system upper reliability goal of 0.95. Since two sub- 
systems are combined in table III, the undominated set should be generated until the 

combination reliability r t r„ is equal to or greater than in this case, until the 

1 ^ 1/2 

combination reliability is equal to or greater than (0.95) 1 - 0.974679. In addition, 
two extra entries are generated to facilitate the next level of combinations. The undom- 
inated entries are joined together sequentially in order of increasing reliability, and 
they form the basis for the next level of combinations. 

Table IV lists the complete family of undominated combinations of subsystems 1 
and 2 which satisfy the reliability requirements, corresponding to the completely 
shaded blocks in table in. 


TABLE IV - UNDOMINATED COMBINATIONS OF 
SUBSYSTEMS 1 AND 2 SATISFYING RELIABILITY 
REQUIREMENTS - EXAMPLE PROBLEM 


( n j,n 2 ) 

Monetary cost, 
C 11 + C 21 

Weight, 
C 12 + C 22 

Reliability , 
r l r 2 

(8,5) 

57 

13 

0 920946 

(9,5) 

61 

14 

944956 

(10,5) 

65 

15 

957303 

(9,6) 

66 

15 

964304 

(10,6) 

70 

16 

976904 

(11,6) 

74 

17 

.983206 

(10,7) 

75 

17 

.983961 


Step 5: Similarly, for subsystems 3 and 4, the procedure as outlined in steps 2 to 4 
can be used to generate the family of undominated combinations of those subsystems. 

For larger systems, pairing would continue for subsystems 5 and 6, 7 and 8, etc. 

Table V shows the development of the undominated combinations of subsystems 3 
and 4. Note that entry (2, 17) - which, of course, is in the sixth column - dominates 
everything in the fourth column costing 65 or more and weighing 19 or more. This 
illustrates the fact that, in eliminating partial rows or columns, attention should be 
given to previous rows or columns rather than just the immediately preceding row or 
column. Also the undominated allocations (2,16), (3,15), and (2,17) are joined sequen- 
tially in order of increasing reliability even though the last entry (2,17) costs less than 
the next to last entry (2, 16). If there had been just a single constraint - monetary cost, 
allocation (3, 15) would have been eliminated because it would, under that condition, 
have been a dominated allocation. Table VI lists the complete family of undominated 
combinations of subsystems 3 and 4 satisfying the reliability requirements. 


21 




2 

w 

_3 

ffi 

o 

ce 

IX 

w 

J 

cu 

2 


> 

w 

J 

CQ 

< 

H 



22 




TABLE VI. - UNDOMINATED COMBINATIONS OF 


SUBSYSTEMS 3 AND 4 SATISFYING RELIABILITY 
REQUIREMENTS - EXAMPLE PROBLEM 


( n 3 , n 4 ) 

Monetary cost, 
C 31 + C 41 

Weight, 
C 32 + C 42 

Reliability, 

r 3 r 4 

(2,12) 

50 

14 

0.917732 

(2,13) 

53 

15 

.944318 

(2,14) 

56 

16 

961600 

(2,15) 

59 

17 

.972598 

(2,16) 

62 

18 

.979471 

(3,15) 

66 

18 

.981440 

(2,17) 

65 

19 

983701 


Step 6 : The next step is to combine the undominated combinations obtained from 
subsystems 1 and 2 with the undominated combinations obtained from subsystems 3 
and 4. This is shown in table VII. The entries along the left of the rows are the char- 
acteristics of the combination of subsystems 1 and 2: first, (nj,n 2 ); second, the mone- 
tary cost of the combination, + C 2 p third, the weight of the combination C 12 + C 22 
and, fourth, the reliability of the combination r^r 2 . Likewise, the column heads are 
( n 3 , n 4 ), C 31 + C 41 , C 32 + C 42 , and r^. 

The undominated family satisfying the reliability range of interest becomes quite 
irregular, as shown by the lines joining the entries in table VII. The complete set of 
undominated allocations satisfying the reliability requirements is shown in table VIII. 
Weight and cost increased about 10 percent in raising the reliability from the mini- 
mum R satisfying R>0.90 to the minimum R satisfying R 5:0.95. 

Figure 6 shows the same set of optimum allocations. The solid stepped line is the 
complete optimum function of reliability against investable monetary cost and weight. 
The number by each of the optimum points is the weight C 2 - 

The problem here was to generate all undominated solutions yielding reliabilities 
from 0.90 to 0.95. This has been accomplished. The procedure, however, need not be 
as lengthy if the optimum configuration for achieving a single specified reliability (say 
0.90) is desired. For this case, table III would have required only three rows and two 
columns; table V, only two rows and three columns; and table VH, only two rows and 
three columns. But this method is really best suited for generating the complete family 
of undominated allocations over a range of R. 
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1, 2, 3, AND 4 - EXAMPLE PROBLEM 


monetary cost, Cjj + C 2J + C 3J + C 41 , weight, C 12 + * C 32 ♦ C 42> 

line connects undominated allocations (completely shaded blocks) J 
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TABLE VIII. - UNDOMINATED COMBINATIONS OF 


SUBSYSTEMS 1, 2, 3. AND 4 SATISFYING 
RELIABILITY REQUIREMENTS - 
EXAMPLE PROBLEM 


(nj.ng.ng.n^ 

Monetary cost, 
C 1 

Weight, 
C ■ 2 

Reliability , 
R 

(9.5,2,14) 

117 

30 

0 908669 

(9,6,2,13) 

119 

30 

.910610 

(9,5.2.15) 

120 

31 

919062 

(10. 5,2, 14) 

121 

31 

920543 

(9,6.2,14) 

122 

31 

.927274 

(10,5,2,15) 

124 

32 

931071 

(9,6.2, 15) 

125 

32 

937880 

(10,6.2,14) 

126 

32 

939391 

(9,6,2, 16) 

128 

33 

944508 

(10.6,2,15) 

129 

33 

950135 



System monetary cost, C. j 


Figure 6. - Optimum solutions to example problem showing system 
reliability as function of system monetary cost with weight as 
the parameter. 


26 




Generalized Lagrange Multiplier Method 


Usefulness of the technique . - The generalized Lagrange multiplier method is dis- 
cussed by Everett (ref. 5) . This method offers a means of obtaining solutions to the op- 
timization of nondifferentiable functions. 

The technique does not, in general, produce all the undominated solutions as does 
the previous dynamic programming technique. The allocations generated by this method 
are, however, shown by Everett (ref. 5) to be optimum. 

Consider the (s + 1) -dimensional space of reliability R against resource expendi- 
tures C j (j = 1 , . . . , s) . The problem of finding the maximum of R subject to the con- 
straints C . (j = 1, . . . , s) is simply the problem of selecting that point in RC . 

' j , max * j 

space of maximum R contained in the subspace bounded by the constraints. As the 
constraints are varied, a set of optimum solutions is generated. 

Figure 7 illustrates a typical set of possible allocations, along with the complete 
family of undominated allocations and the incomplete set generated by Lagrange multi- 
pliers, for the simple case of a single type of cost. Only a part of the complete family 
of solutions is generated by this method, namely, those points lying on the convex hull 
of the reliability -cost space. The points generated by this procedure are, thus, in a 
sense the "best” of the optimum solutions. 

The solutions produced by the method of generalized Lagrange multipliers are 
usually close enough together so that the fact that some solutions are missed is not often 
a problem. However, on occasion, when these so-called gaps occur in regions of criti- 
cal interest, there are several useful techniques that can be used to fill the gaps. These 
are discussed by Everett (ref. 5) and are not repeated herein. 



Figure 7 - Typical reliability-cost space for single type of cost 
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Formulation of the method . - The basis of the integer Lagrange method is that the 
Lagrangian can be maximized by any means whatsoever. In differentiable functions this 
is done by setting the derivative to zero. The Lagrangian can also be maximized by 
trial and error, computer scanning of all possibilities, or analytical maximization (by 
zeroing the derivative) of a continuous function which approximates the discrete function. 
Lagrange multipliers is a technique for converting constrained optimization problems 
into unconstrained maximization problems. 

The problem to be solved is stated in terms of problem I by equations (3) and (4) 
which are repeated here. 

Problem I: Maximize 


R = 



(3) 


subject to 


m 

Z c ij n i ~ C • j , max j = 1, • • • , s; m integer (4) 

i=l 

The logarithm of R is a monotonic function of R, so equation (3) could be restated as 
follows: 

Problem I: Maximize 


m 

In R = ^ In iv (20) 

i=l 

The objective function of equation (7) is now in the form of a general cell or 
separable problem. There are m subsystems (cells) into which the resources may 
be committed and for which the overall objective function is simply the sum of the ob- 
jective functions of each cell. 

Everett's technique (ref. 5) applies to the solution of cell problems for which the 
objective function is a concave function. It is shown in appendix A that In R is concave 
when 
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k. - 1 

n. > — 1 i = 1, . . . , m (A6) 

Pi 

for the series-k-out-of-n system. 

Under these conditions, the generalized Lagrange multiplier technique can be used. 
The technique requires the use of Lagrange multipliers A. (j = 1, . . . , s) associated with 
each of the s types of cost. The unconstrained objective function for solving this prob- 
lem by Everett’s method (ref. 5) is to maximize 

s 

H(nj) = In r.(nj) - V X.C.A i = l,...,m (21) 

H 


for each subsystem independently of the strategy choices in other subsystems. The re- 
sulting allocation is designated n = (n^, , n m ) . Summing In r^m) over i = 1 , . . . , m 
and exponentiating yields total system reliability R(n). Summing c..n. over 
i = 1, . . . ,m yields the total system cost of the j type, C .(n). This allocation is 
a solution to the overall constrained problem with constraints equal to the total re- 
sources C j(n) (j = 1, . . . ,s) consumed by the strategy n. 

The proof that equation (21) leads to the same optimal allocation as equation (20) 
follows that of Everett (ref. 5) and is presented in appendix B: That proof shows that 
any solutions produced by Lagrange multipliers are optimum, undominated solutions. 

The values of R(n) and C j(n) may not satisfy the requirements of the problem 
since they are outputs of the Lagrange procedure. Unfortunately, the Lagrange multi- 
pliers yielding the solutions of interest are not known beforehand and must be deter- 
mined in the course of the procedure. 

Everett (ref. 5) shows that if all but one resource level is held constant, the re- 
source that changes is a monotone decreasing function of its associated Lagrange multi- 
plier. This means that the multipliers should be adjusted accordingly to achieve some 
given constraints on the resources. 

Experience has shown that a good practice is to set all except one value of 


A. (j = 1, . . . , s) to zero and vary the nonzero A^ in such a way that at most one n^ 
changes by at most one unit until all allocations are produced which yield system relia- 


bilities of interest. This is then repeated for each value of j. If more solutions are 


desired, combinations of the A/s used previously are tried. 

Figure 8 shows the steps in Everett's generalized Lagrange multiplier procedure. 


Lagrange multipliers used on an example problem . - The example problem given in 
the preceding main section is used here to illustrate the usefulness of this method in 
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Figure 8. - Steps in Everett's Lagrange multiplier procedure (ref. 5). 


generating a part of the family of undominated allocations. The system is illustrated in 
figure 3. The goal is to generate the incomplete set of undominated allocations having 
reliabilities from 0.90 to 0.95. 

Table IX shows the solutions produced by a series of X^, X ^ values. Inspection of 
the results for varying only one of the X's while keeping the other fixed shows that the 
changes in allocation from one solution to the next consist of at most one additional com- 
ponent in at most one subsystem. Values of the Lagrange multiplier between these solu- 
tions will thus produce no new solutions. 

Combinations of nonzero X^ and Xg were tried and produced only repeats of those 
optimum allocations presented in table IX. 

Figure 9 shows the solutions produced by this method superimposed on the complete 
family of undominated allocations. Several points cannot be obtained from the use of 
Lagrange multipliers. The importance of these missed points is less pronounced for 
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TABLE IX. - LAGRANGE MULTIPLIER SOLUTIONS TO EXAMPLE 


PROBLEM FOR SYSTEM RELIABILITY FROM 0.90 TO 0.95 



a Repeat solution. 



System monetary cost, C. j 


Figure 9. - Optimum solutions by Lagrange multipliers to example problem 
showing system reliability as a function of system monetary cost with 
weight as the parameter. 
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systems consisting of many subsystems because, in general, more solutions are gener- 
ated. Everett (ref. 5) describes several schemes for generating the missed solutions. 

An advantage for the Lagrange multiplier technique is that, rather than producing the 
entire set of undominated allocations, it allows one to approach more readily a relia- 
bility or cost constraint. 

Figure 10 shows the complete set of optimum solutions plotted as reliability as a 
function of a single type of cost. Each pair of convex hull points produced by the method 
of Lagrange is connected by a straight dashed line to show why these points are referred 
to as the "best" of the undominated solutions. 
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Figure 10. - Optimum solutions by Lagrange multipliers to ex- 
ample problem showing system reliability as function of sys- 
tem monetary cost and weight. 



Method of Balancing Sensitivities 


Usefulness of the technique . - Another procedure which readily produces some of 
the optimum solutions is discussed by Barlow and Proschan (ref. 1), Breipohl (ref. 35), 
Isayev and Mamed-Zade (ref. 36), Kulakov and Zagoruyko (ref. 11), and Thakkar and 
Hughes (ref. 16). The procedure consists of selecting consecutively for redundancy the 
subsystem which has the most to offer in increasing reliability per unit of weighted 
costs. 

The technique produces only a part of the complete family of undominated alloca- 
tions. It is useful in generating a set of solutions over a range of reliabilities and costs 
rather than in approaching readily a reliability or cost constraint. As with the two pre- 
vious techniques, the solutions obtained are optimum and, hence, satisfy the formula- 
tions of both problems I and II. This method is shorter to use than Lagrange multi- 
pliers and involves less trial and error. 

Formulation of the method . - The optimality of this procedure is dependent upon the 
concavity of the subsystem reliability r^n^) (i = 1 , . . . , m) . That condition is satisfied 
by equation (A 6) 

k. - 1 

n. > — 1 i = l,...,m;n. integer (A6) 

1 Pi 

for the case where the subsystems are of the k-out-of-n type. 

The cheapest allocation, but one which may not satisfy reliability requirements, is 
one with no redundancy. In such a system, n^ = k^ (i = 1, . . . ,m). It is unreasonable to 
start at this allocation, however, because the resultant system would likely be very un- 
reliable or else redundancy would not be considered. Instead a more reasonable start- 
ing point is with the system consisting of so-called basic subsystems. A basic subsys- 
tem has been defined in equation (19) as one whose subsystem reliability is at least as 
great at the minimum system reliability goal H m ^ n - That is, choose n^ such that 

r i (m) > R min i = 1 , . . . , m; n. integer (19) 

ii. 

For a single type of cost (s = 1), the sensitivity of the l subsystem is the ratio 
of the change in system reliability to the change in cost resulting from the addition of 
only one component in only the i tJl subsystem. Suppose the allocation of basic sub- 
systems satisfying equation (19) is designated (n^ . . . , n ). The next solution is obtained 
by adding one component in the subsystem where it will provide the greatest improve- 
ment in system reliability per unit cost, that is, by selecting for redundancy the sub- 
system with greatest sensitivity. The sensitivity of the i^ subsystem is just 
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s. = 

1 


R ( n l ’ • ’ n i-l ’ n i + 1 ’ n i+i > • • • > n m ) “ R ( n i » ■ • • > n m ) 


i = 1, • • • ,m 


( 22 ) 


c i 


The subsystem having maximum S. (i = 1 , . . . , m) is selected for redundancy. The new 
allocation is used to compute a new set of S- (i = 1, . . . , m), and successive solutions are 
generated until either the cost or reliability constraint is reached. 

Sensitivity must be redefined for the case of multiple cost factors. It is the ratio 
of change in system reliability to change in some weighted cost resulting from the addi- 
tion of only one component in only the i^ subsystem. The sensitivity of the i^ sub- 
system is 


S. = 

i* 


R (n 1 ,---,n i - 1 , n i + l> n i + 1 ’ • ~ • >n m ) -R(n v ...,n m ) 

s 

V a.c.. 

^ ] i] 

j=l 


i = 1, . . . ,m 


( 23 ) 


where the a . '( j = 1 , . 


s) are nonnegative weights satisfying 


E 


1=1 


a. 


= 1 


( 24 ) 


The vectors (a. , . . . , a ) are chosen by varying the a. by some fixed increment until 

s J 

all choices from (1,0,..., 0) to (0, ...,0, 1) have been exhausted (ref. 1). 

Equation (8) can be used with equation (1) to give 



( 25 ) 


and 


R(n r . . • ,n i _ 1 , n. + 1, n. +1 , . . . ,n m ) = R(n v . . . ,n m ) 


k. n. -k.+l ; 

i + Pi y 1 


n i 


k i-i- 


( 26 ) 
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Using equation (26) in (2-8) yields 


k. n.-k.+l/ n i 

*iV 


RK nj 


S i- = 


tk. - 1, 


i = 1 , . . . , m 


V a.c.. 
^ ] U 

j-1 


(27) 

I 


A set (a,, . . - , a ) is selected and S, is computed for each value of i = 1, . . . , m; the 
subsystem having the maximum sensitivity is selected to receive one additional com- 
ponent . 

It is noted that R(n^ , . . . , n m ) is a constant for all i, . . . , m so a new quantity is 
defined by dividing both sides of equation (27) by R(n^ , . . . ,n ), 


i = 1 , . . . , m; m integer (28) 


B i is selected for the next level of redun- 
dancy. The process is repeated until a cost or reliability constraint is reached. A new 
set of a. (j = 1, . . . , s) is chosen and the entire procedure repeated. The steps are 
shown in figure 11. 

Balancing sensitivites for an example problem . - Table X shows the operation of 
^iis procedure on the example problem previously discussed in connection with Kettelle's 
procedure and the Lagrange multiplier method. The reliability range of interest here 
again is 0.90 to 0.95. The basic requirements, which exceed the minimal concavity 
conditions and which are used to initialize the procedure, are n^ = 7, ^ = 4, n^ = 1, 
and n^ = 12. The solutions having reliability from 0.90 to 0.95 are the same ones de- 
termined by the integer Lagrange method. This is because both methods determine 
points on the convex hull of the possible allocations. 

Values of a^ from 0.0 to 1.0 in increments of 0.05 (and ag = 1 - a^) failed to 
produce any new solutions. 


k n -k.+l/ n i 

Pi q A 


B. = 

l 


ikj - 1; 


f a. Ci . 
^ ] i] 


j=l 


The subsystem having the maximum value of 
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Figure 11. - Steps in procedure of balancing sensitivities. 















TABLE X - SENSITIVITY PROCEDURE ON EXAMPLE PROBLEM 


n 

1 

B 1 

n 2 

B 2 

n 3 

B 3 

n 4 

B 4 

Reliability, 

R 

Monetary 

cost, 

C 1 

Weight, 
C • 2 








a l = 

1, a 

2 = C 





7 

0.011612 

r 

4 

0.010584 

1 

0.012857 

12 

0.008952 

0 690886 

91 

24 


7 

.011612 

4 

.010584 

2 

.001286 



.008952 

.759974 

98 

25 


8 

.006193 

4 

.010584 



.001286 



. 008952 

799034 

102 

26 


8 

006193 


5 

.003969 



.001286 



.008952 

. 845182 

107 

27 


8 

.006193 



.003969 



.001286 


3 

.005819 

.869666 

110 

28 


9 

.003185 



.003969 



001286 

13 

.005819 

. 892339 

114 

29 



.003185 


' 

.003969 



.001286 

14 

.003703 

908669 

117 

30 



.003185 

6 

.001429 



001286 

14 

.003703 

.927274 

122 

31 



.003185 

6 

001429 



.001286 

15 

.002314 

.937880 

125 

32 


.001593 

6 

.001429 



.001286 

15 

002314 

.950135 

129 

33 








a l = 

0, a 

2 = 1 





7 

— 

0.046449 


' 

0.052920 

— 

1 

0.090000 

12 

0.026855 

a 0. 690886 

91 

— 

24 


7 

.046449 

4 

.052920 

2 

.009000 



.026855 

a . 759974 

98 

25 


7 

.046449 



.019845 



009000 



.026855 

829881 

103 

26 


8 

.024773 



.019845 



.009000 



.026855 

a . 845182 

107 

27 


8 

.024773 



.019845 



.009000 

13 

.017456 

a . 869666 

110 

28 


9 

.012740 



.019845 



. 009000 

13 

.017456 

a . 892339 

114 

29 

9 

.012740 

£ 


.007144 



.009000 

13 

.017456 

910610 

119 

30 


9 

.012740 



.007144 



.009000 

14 

.011108 

a . 927274 

122 

31 

10 

.006370 



.007144 



.009000 

14 

.011108 

.939391 

126 

32 

10 

.006370 



007144 



.009000 

15 

.006943 

a . 950135 

129 

33 


a Repeat solution. 
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Conversion of Problem I to Multidimensional Knapsack Formulation 


Ghare and Taylor (ref. 6) develop a method for determining the optimum number of 
redundant components in a series-parallel system subject to several cost constraints. 
This is a nonlinear integer programming problem which they show can be transformed 
to an associated zero-one programming problem solvable by a branch -and -bound proce- 
dure. Their work shows that the optimal solution to the associated problem is equiva- 
lent to the optimal solution for the redundancy problem. 

The purpose of this section is to show that the series-k-out-of-n redundancy alloca- 
tion problem can also be transformed to the multidimensional knapsack formulation and, 
hence, is amenable to solution by the same techniques used by Ghare and Taylor in ref- 
erence 6. The knapsack problem is discussed in a general way by Saaty (ref. 21). 

The nonlinear programming formulation of the series-k-out-of-n redundancy alloca- 
tion problem is stated as problem I (eq. (3)) 

Problem I: Maximize 


m 


R = 


r. 

l 


(3) 


subject to the several cost constraints of equation (4). 


m 


Z c ij n i ~ C • j, max i = n i integer 


(4) 


i=l 


The subsystem reliability r^ (i = 1, . . . ,m) is given by equation (8) for k-out-of-n 
subsystems as 


n.-k. 

k. V V ki - 1 + xN 

r i = Pj 1 \ ( jq* i = 1, . . . ,m; k.,m integer 

x=0 


( 8 ) 


When equation (8) is used in equation (3), problem I becomes 
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Problem I: Maximize 



( 29 ) 


subject to the constraints of equation (4) . 

A feasible solution to this problem is the set of numbers n = (n^ , . . . , n ) satisfying 
the constraints of equation (4). In order to solve this problem, consider an alternate 
problem, designated problem IA. It must be shown that a one-to-one correspondence 
exists between the feasible solutions for problems I and IA as applied to the series-k- 
out-of-n system. 

The associated zero-one programming problem is 


Problem IA: Maximize the quantity 


m 00 

E Z a i i\i 

i=l 1=1 

subject to the constraints 

m °° 

Z Z c ij x u- b j j = 

i=l 1=1 


(30) 


(31) 


where x^ equals 0 or 1 and where x^ = 0 implies x^ , 
Further, let the following relations hold: 


= 0 


if V > l. 



i = 1 , . . . , m; kj integer 


b. 

] 


= C 


■ ] , max 


m 


- 1 


c. .k. 
i] i 


i = 1, 


(32) 


(33) 
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In order to show a one-to-one correspondence between the feasible solutions to 
problems I and IA, it is necessary (1) to express the set of numbers n satisfying prob- 
lem I in terms of problem IA variables and (2) to show that R is maximized when Z 
is maximized . 

Let X = jx^j be a feasible solution to problem IA and let i. be the largest index 
such that x^ = 1. Using this and equation (33) in equation (31) yields 

m m 

I - X/ C ij k i j = l,...,s (34) 

i=l i=l 

Rearranging equation (34) results in 


m 

s 

i=l 


c. .(I ■ + k.) 
i r i i 


■ j , max 


j = 1, • • • ,s; L,k t integer 


(35) 


Now equation (35) is equivalent to the constraint of problem I, given by equation (4), 
when 


n i = ^ i + k i i = 1,. ..,m; Jpk^n. integer 


(36) 


Thus, the set of numbers n forming the solution to problem I is expressible in terms 
of problem IA variables. 

To show that R is maximized when Z is maximized, equation (32) is used in equa- 
tion (30) along with the definition of L being the largest index such that x^ = 1, 



When the second summation, that is, the summation from 1 = 1 to l = l., is expanded, 
successive terms of the summation cancel and Z reduces to 
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m 



i=l 


When the relation of equation (36) is used, equation (38) becomes 



From equation (29), the natural logarithm of R is 


m 



i=l 


Using equation (40) in equation (39) results in 

m 

Z = In R - ^ k i In p i k i integer (41) 

i=l 

The summation term in equation (41) is a constant. Since R and In R maximize 
simultaneously, equation (41) shows that when Z is a maximum, R is also. This com- 
pletes the proof of a one-to-one correspondence between problems I and LA. 

Problem IA is a multidimensional knapsack problem for which Ghare and Taylor 
(ref. 6) develop a solution by a branch -and -bound procedure. The optimum solution to 
problem LA is obtained and converted to the optimal solution for problem I by the relation 
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n i = z i + k i (i = 1> • • • >' m )- 

The method of this section is relatively free of the problem of dimensionality that 
plagues the dynamic programming techniques, according to Ghare and Taylor (ref. 6). 
The solutions produced are exact solutions. 

It has been shown that the method of Ghare and Taylor (ref. 6) is applicable to the 
problem of optimally allocating redundancy in the series-k-out-of-n system in such a 
way that reliability is maximized without exceeding any of s cost constraints. 


Solution of Problem I by Method of Integer Concave Programming 

Mizukami (ref. 7) presents a method for determining the optimal redundancy for 
the series-parallel system so as to achieve maximum system reliability under multiple 
cost constraints. He approximates the reliability function with piecewise linearization 
and, thus, obtains a solution which is approximate. 

The method used is a synthesis of the methods of concave and integer programming. 
He refers to his method as the method of convex and integer programming because his 
general problem involves minimization of a convex objective function. For reliability 
optimization, however, the problem is one of maximizing a concave reliability function. 
Hence, the method which he uses is, in reality, integer concave programming, the max- 
imization analog of integer convex programming. 

The system reliability is the product of the subsystem reliabilities and, hence, is 
nonlinear; thus, exact solutions are not attainable by linear programming. In the 
method of Mizukami (ref. 7) the objective function to be maximized is first converted to 
a sum of separable concave functions, which are approximated by piecewise lineariza- 
tion. Thus, the methods of linear programming can be used for optimizing the approxi- 
mate objective function. A method of integer linear programming is finally used to ob- 
tain the optimal redundancy allocation in integral numbers of components. 

The purpose of this section is to show that the method used by Mizukami (ref. 7) 
for the series-parallel system can be used as well for the series-k-out-of-n system with 
some limitations on the objective function. 

The reliability of the i subsystem when it contains n. components is given by 
equation (8) as 



i = 1 , . . . , m; k^ , n. integer 


( 8 ) 
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Number of components, n. 


Figure 12 - Reliability of subsystem i as function of number of 
components, with continuous approximation. Minimum num- 
ber of components required, 4; component success probability, 
0 5 


The r^ as determined from equation (8) is a step function of n^ as shown for example 
in figure 12, because n^ is an integer. To use the method of concave programming, a 
continuous function is needed. A continuous approximation to the step function, drawn 
through the integer points, is shown in figure 12. 

Replacing n. by x. (i = 1 , . . . , m) to denote continuity (for the time being) in the 
number of components, the reliability of the i subsystem with x^ components is 
r.(Xj) (i = 1, . . . ,m). Since In R is a monotone-increasing function of R, maximizing 
In R is equivalent to maximizing R. Thus, problem I can be rewritten as 

Problem I : Maximize 


m 

In R = Yj ^ r i (x.) (42) 

i=l 


subject to the cost constraints 


m 

c ij x i ~ C - j, max 
i=l 


j = 1, • • -,s 


(43) 


where 


x. > k. 
1 x 


i = l,...,m 


(44) 
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The objective function of equation (42) must be concave in order to use the method 
of concave programming. This results in a further restriction on x , as developed in 
appendix A , 


k. - 1 

x. > — 1 i = 1, . . . ,m (45) 

Pi 


In figure 13 the concave portion of In r^(x.) is approximated by a broken-line func- 
tion. Since In r^(x^) is continuous, h + 1 points on the curve can be selected such that 



Figure 13 - Concave portion of In qlx,) approximated by a broken- 
line function 


the broken-line fit through these points is a suffuciently close approximation, according 
to Dantzig (ref. 49). The rectilinear equation is of the form 

y i = X i,f( x i " k i) + Pi,t i = 1 , . . • , m; t = 1 , . . . , h (46) 

where y. is the broken-line approximation for In r,(x.), . is the slope of the 

1 1 X 1 j L 

broken line, t is the value of y^ at x^ = k^, and t simply designates which value of 
x^ is under consideration. Since In r^(x^) is concave, the region below In r^(x^) may be 
represented approximately by 


yi sx i,t (X i" k i )+M i,t 


i = 1, 


t = 1. 


(47) 
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Finally, the problem may be written in linear programming notation as 


Problem: Maximize 


Z = 


m 


I 




( 48 ) 


subject to 


y i ~ X i,tK ‘ k i^ + ^i,t i = ! , . . • , m; t = 1, . . . ,h 


m 


E c. .x. < C . 

i] i •], 

i=l 


max 


j = !,•••, s 


x. 2 k. i = 1 , . . . , m; Xj, k. integer 


k. - 1 


x. > — 1 i = 1, . . . ,m; x.,kj integer 

Pi 


where the slope A. . and the intercept p. . are given by (see fig. 13) 

1, L 1, L 

lnr^x. t ) -lnr^x ul ) 


X i,t = 


x i,f x i,t-l 


i = 1, . . . ,m; t = 1, .. . ,h 


and 


(49) 

(50) 

(51) 

(52) 


(53) 


^i,t 


_ (x i t -k.) In r i (x i t _ 1 )-(x i t _ 1 -k i ) In r.(x i t ) 


x. . - x. . i 
i,t i,t-l 


i = 1, . . . , m; t = 1 h 


(54) 


The derivation of equation (54) is shown in appendix C as equation (C3) . 

The problem is now in linear form, amenable to solution by linear programming 
methods, if the integer restrictions on x^ (i = 1, . . . , m) are ignored temporarily. If the 
optimum solution happens to satisfy the integer conditions, the problem is solved. If 
not, the integer programming approach of Gomory (ref. 50) can be used to produce the 
integer solutions. 
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In summary, the nonlinear reliability function for the series-k-out-of-n system can 
be approximated by piecewise linearization. The reliability function must be concave and 
must be approximated by a continuous function. Under these conditions, the approximate 
reliability function can be maximized subject to constraints by the method of linear pro- 
gramming. Integer programming can then be used to satisfy the integer restrictions. 

Although this procedure yields solutions which are approximate, the solutions can 
be made arbitrarily accurate by the appropriate choice of the number h of linear func- 
tions. 


Comparison of Methods 

The method of Kettelle (ref. 3) provides the complete family of undominated alloca- 
tions to the redundancy optimization problems. It is a dynamic programming procedure 
and, hence, becomes quite unwieldy for large systems subject to many constraints. It 
is readily adapted to computer analysis, however; Proschan and Bray (ref. 4) discuss a 
computer program capable of handling a maximum of three constraints, a maximum of 
64 subsystems, a maximum of 10 components in each subsystem, and a maximum of 
1024 entries in the dominating set at any combination of subsystems. They give guide- 
lines in estimating the practicality of attempting to solve problems by their procedure. 
According to them, the only method for determining whether it is practical to solve a 
given problem is to attempt to find the solution. Kettelle (ref. 3) and Proschan and Bray 

(ref. 4) both introduced an assumption in producing their dominating sets which resulted 

2 

in an error in the resulting reliability of no more than (1 - R) . That unnecessary as- 
sumption was eliminated from the development presented herein. The procedure pro- 
duces exact solutions. 

The partial list of undominated solutions comprising the convex hull, or "best, " 
optimum allocations is determined by the method of Lagrange multipliers developed by 
Everett (ref. 5). A trial -and -error procedure is required in the selection of the 
Lagrange multipliers; the multipliers yielding the optimal solutions are not known be- 
forehand but are produced in the course of the solution. This technique is most useful 
in determining the single best allocation satisfying the constraints rather than in gener- 
ating the optimum solutions over a range of the constraints. The complexity increases 
substantially with the number of constraints - an obvious disadvantage for the many- 
constraint problem. 

The same convex hull points are produced more readily by the method of balancing 
sensitivities. Because the procedure begins with so-called basic subsystems, the pro- 
cedure is particularly well-suited to generating a set of solutions satisfying a range of 
constraints. The convex hull solutions are produced with much less effort than by the 
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method of Kettelle (ref. 3). The trial and error involved in selecting the appropriate 
weighting factors is minimal compared to the trial and error involved in the method of 
Lagrange multipliers. Since all combinations of weighting factors from 1,0, ... ,0 to 
0, ... ,0,1 must be investigated to assure that none of the possible solutions is missed, 
there is an obvious problem of dimensionality here for problems involving many con- 
straints . 

These last two procedures produce only the convex hull points and, as such, they 
may miss the optimal allocations of interest. It is suggested that one of these last two 
methods be used to produce an optimal allocation whose reliability or cost vector is at 
the lower extreme of the range of interest. This allocation could then be used as a start- 
ing point for the dynamic programming procedure, and the successively larger redun- 
dancy allocations could be produced with much less effort than if the dynamic program- 
ming procedure were begun with basic subsystems. 

The method of Ghare and Taylor (ref. 6) is the preferred method of producing exact 
solutions to problem I, the problem of maximizing reliability subject to several cost 
constraints. They have written a computer program solving problems with as many as 
100 subsystems, 15 constraints, and 500 redundant components. The program requires 
only 5500 words of memory space on the IBM 360/50 system. 

The method of integer concave programming (Mizukami, ref. 7) produces approxi- 
mate solutions to problem I . The advantage of this technique is that standard linear pro- 
gramming methods can be used. For integer solutions, Mizukami suggests Gomory's 
(ref. 50) integer linear programming technique. The approximations introduced by this 
method can be made arbitrarily good but at a cost in complexity. 


SERIES-PARALLEL SYSTEM 

Much of the literature on redundancy deals with the case where only one component 
in a given subsystem is required to operate for subsystem success. Such a subsystem 
is a special case of the k-out-of-n subsystem, that is, a 1-out-of-n subsystem. More 
commonly, this is referred to as a parallel subsystem. When subsystems which utilize 
parallel redundancy are serially connected in. a system, the resulting system is called a 
series -parallel system. Such a system is shown in figure 2. 

The problem of redundancy optimization for series -parallel systems is not unsolved, 
as evident from the literature review where most of the references cited refer to solu- 
tions for just such a problem. All five of the methods used in the preceding section for 
the series-k-out-of-n system were originally applied, with success, to the series- 
parallel redundancy problem. 

In this section, two closed-form equations are derived for the approximate optimum 
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distribution of redundancy under the models of problems I and II when there is only a 
single type of cost. The method used in the derivations is the method of Lagrange multi- 
pliers . 

Closed-form equations have been derived previously by several different methods. 
Federowicz and Mazumdar (ref. 9) used geometric programming and Mine (ref. 8) used 
calculus of variations to determine the allocation of redundant components maximizing 
reliability for a fixed cost constraint. Their equations are identical to each other and to 
the one derived herein by Lagrange multipliers. Moskowitz and McLean (ref. 10) used a 
variational technique and Kulakov and Zagoruyko (ref. 11) used sensitivity balancing to 
produce two slightly different equations for minimizing a single type of cost while 
achieving a fixed reliability. An equation which is slightly different from those two 
equations is derived herein by the use of Lagrange multipliers. A comparison is made 
of the two equations cited from the literature and the equation derived herein. 

The equations cited herein and derived herein are approximate in that they result 
in nonintegral numbers of components. The optimum reliability -cost curve generated 
by these equations is what could be achieved by using fractional components. Integer 
programming (ref. 21) could be used to adjust these solutions to the optimal integer 
solutions. 

Solutions by use of the equations derived herein are compared with the exact integer 
solutions produced by Kettelle's dynamic programming procedure (ref. 3) on an example 
problem. The agreement is quite good. 


Maximizing Reliability for Fixed Cost 

The problem is to optimize the number of redundant components in each of m sub- 
systems of a series system. Each subsystem has n^ components in parallel, at least 
one of which must be operative for subsystem success. The optimization is done in such 
a way that the reliability is maximized for a given cost. 

It is assumed that the system, subsystem, or component can exist in only two pos- 
sible states: success or failure. The failure of one component has no effect on the fail- 
ure of any other component. System success requires operation of all subsystems; that 
is, the subsystems are all in series. 

The appropriate equations are shown in the section Subsystems of the 1-out-of-n 
Type. If equation (9) is used in equation (3) and n. is replaced by the continuous varia- 
ble x^ (i = 1 , . . . , m) , the problem can be stated as 
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Problem I: Maximize 


m 



i=l 


( 55 ) 


for a fixed cost given by equation (10) with m replaced by x^, 

m 

C = £ c i x i (56) 

i=l 

Since In R is a monotone increasing function of R, the logarithm of R is chosen for 
maximization. If equation (2) is expressed as 

m 

g - c - c iXi = 0 (57) 

i=l 


problem I can be expressed as the unconstrained maximization problem, 
Problem I: Maximize 


h = In R + Xg (58) 

Using R from equation (55) and 


m 

Z c i x i ( 59 ) 

i=l 

The reliability is maximized subject to the constraint of equation (57) when the partial 
derivative of h with respect to is set equal to zero, 


where X is the Lagrange multiplier to be determined, 
g from equation (57) in equation (58) results in 


m 

h = ^ ^ In (l - q^j + XC - X 
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i = 1 , . . . , m 


(60) 


_3h 

3x. 

l 


-q A 1 (ln q t ) 



\c { = 0 


because the condition for a maximum, namely, 




is met. 

Equation (60) can be rewritten 


(61) 


X = 



i = 1 , . . . , m 


(62) 


The quantity X in equation (62) is a Lagrange multiplier which is a constant for all sub- 
systems under optimality conditions. 

Equation (62) can be rewritten as 


X’ = 



, m 


(63) 


An approximation is now introduced in assuming X' to be nearly constant for all sub- 
systems. This is a reasonable assumption for reasonably reliable systems consisting 

x. 

of a large number of subsystems because, in those cases, 1 - q^ 1 « 1 for i = 1, . . . ,m. 
It is shown later how the approximation introduced by this assumption can be circum- 
vented . 

Working with the logarithm of equation (63) yields, after rearrangement, 

x.~^_ 

1 -In q. 


-In 




+ In X 


i = 1, . . . ,m 


(64) 
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The quantity X' is still undetermined, so an expression for it in terms of known quanti- 
ties is needed. 

Putting equation (64) into the system cost equation (eq. (56)) yields 


m 



i=l 


This can be solved for In X' in terms of known quantities. After rearrangement, 


m 



i=l 


This expression can be put into equation (64) yielding 



The usefulness of equation (67) is in being able to determine the required number of com- 
ponents in each subsystem in such a way that the reliability is maximized for a given 
cost. The x^ (i = 1, . . . , m) are seen to be functions of known quantities, namely, the 
system cost, the component costs, the component failure probabilities, and the number 
of serially connected subsystems. 
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The effect of the approximation in equation (67) is usually negligible for large, rea- 
sonably reliable systems. The error can be eliminated, however, by the following ad- 
justments: An say x^ , is computed from equation (67). The quantity X is com- 
puted from equation (62) with i = 1 as 


X = 


X 1 

(-In qj)qj 




But rearrangement of equation (62) results in 


( 68 ) 


x. = — 1 — In 1 

1 -In q. 



i = 1, . . . , m 


(69) 


The x^ (i = 1, . . . , m) of equation (69) are optimal, but the reliability and cost which 
they yield may differ slightly from that specified. Therefore, the reliability should be 
computed by using x^ from equation (69) in equation (55), and the cost should be com- 
puted by using x^ from equation (69) in equation (56) . 

The x^ (i = 1, . . . ,m) determined from equation (69) are not exact, in the sense that 
they may not be integers. Integer programming (ref. 21) could be used to determine the 
optimal integer solution m (i = 1 , . . . , m) starting with the nonintegers x. (i = 1, . . . , m). 


Minimizing Cost for Fixed Reliability 

The purpose here is to generate the approximate optimum arrangement of compo- 
nents for achieving a fixed reliability goal at minimum expenditure of resources. This 
one cost factor which is being minimized can be any single factor such as weight, vol- 
ume, or monetary cost. 

If equation (10) is used and n^ is replaced by the continuous variable 
x^ (i = 1 , . . . , m) , the problem can be stated as 

Problem II: Minimize 



i=l 


c i x i 


(70) 
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for a fixed reliability given by combining equations (9) and (1), replacing n^ by 


m 



i= 


When the logarithm of both sides of equation (71) is taken, it can be written that 


g = In R - 




(72) 


Problem II can be expressed, by introducing a Lagrange multiplier X, as the uncon- 
strained minimization problem, 

Problem II: Minimize 

h = C + Xg (73) 


Using C from equation (70) and g from equation (72) in equation (73) results in 


m m 

h = ^ c^x i + X In R - X In ^1 - q i ^ 

i=1 i=l 


(74) 


The cost is minimized subject to the constraint of equation (72) when the partial deriva- 
tive of h with respect to x^ is set equal to zero 


x. 


9h 

9x i 


= c. + 

i 


Xq.^in q.) 


= 0 i = 1, . . . ,m 


(75) 


x. 


i-di' 
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because the condition for a minimum is met, namely, 




Equation (75) can be rewritten 


X 




i = 1, 


, m 


( 76 ) 


(77) 


The quantity X in equation (77) is a Lagrange multiplier which is a constant for all 
subsystems under optimality conditions. Equation (77) can be rewritten as 


X' = 


X 



c i 



i = 1, . . . ,m 


(78) 


An approximation is now introduced in assuming X' to be nearly constant for all sub- 
systems. This is a reasonable assumption for reasonably reliable systems because, in 
x. 

those cases, 1 - q^ 1 « 1 for i = 1, . . . ,m. The quantity X is constant under optimality 
conditions. It is shown later how the approximation introduced by this assumption can 
be circumvented. 

Working with the logarithm of equation (78) yields the equation for x^ as 


1 -In q. 


-In 


c. 

i 


V ln % 


+ In X' 


i = 


(79) 


The quantity X’ is still unknown so an expression for it in terms of known quantities is 
needed. 
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The system reliability of equation (71) can be approximated by 


m 



i=l 

because the crossproduct terms are small for reasonably reliable systems. In fact, the 

2 x i 

error in R as computed from equation (80) is at most (1 - R) . If q^ from equa- 
tion (78) is substituted into equation (80), 

m 



i=l 

Rearranging equation (81) and taking logarithms results in 



This expression for In X' can now be used in equation (79), giving 



The effect of the approximations introduced by assuming X' constant and by equa- 
tion (80) upon the results of equation (83) is usually negligible for reasonably reliable 
systems. The error can be eliminated, however, by the following adjustments: An x., 
say Xj, is computed from equation (83). The quantity X is computed from equation (77) 
with i = 1 as 
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(84) 


X = 





But rearrangement of equation (77) results in 


x. 

1 


1 

-In q i 


In 


1 + X 



i = 1 


m 


(85) 


The x. (i = 1, . . . ,m) of equation (85) are optimal, but the reliability and cost which 
they yield may differ slightly from that specified. Therefore, the reliability should be 
computed by using from equation (85) in equation (71), and the cost should be com- 
puted by using x^ from equation (85) in equation (70). 

The x. (i = 1, . . . , m) determined from equation (85) are not exact, in the sense that 
they may be nonintegers. Integer programming (ref. 21) could be used to determine the 
optimal integer solution (i = 1 , . . . , m) , starting with the nonintegers x^ (i = 1 , . . . , m) 
Moskowitz and McLean (ref. 10) used a variational technique to arrive at an equa- 
tion analogous to equation (83) . Their equation is 


x. » — - — In 1 
1 In q. 


/ m 

( c i / - ln c ‘i)/2j C i / ' ln q i) 

- R ' 1=1 


= 1 , • • • , m 


( 86 ) 


Kulakov and Zagoruyko (ref. 11) used balancing of sensitivities to get 
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(1 - R) 


(y- ln qQ 


I^( c i / - lnq i) 

i=l 



(c./-ln q.) 

R + (1 - R) — 

\ 1 V 


m 

X^( C i Aln ■*!) 

i=l 


( 87 ) 


A comparison of equations (83), (86), and (87) is shown in the next section, where 
an example problem is solved. 


Example Problem 

An illustrative example of the use of the closed -form approximate solutions for 
x i (i = 1, . . . ,m) is the problem solved by Kettelle (ref. 3). The system consists of four 
subsystems in series, each subsystem requiring operation of one of the possibly more 
than one parallel components. Component costs and success probabilities are shown in 
table XI. The system is also illustrated in figure 14. 


TABLE XI. - COMPONENT PARAMETERS 
FOR EXAMPLE PROBLEM 




Subsystem 

1 

1 

2 

3 

4 

Component cost, 

1.2 

2.3 

3.4 

4.5 

Component success 

0.8 

0.7 

0.75 

0.85 

probability, p^ 
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Pl • o 8 

Cj= 1 2 

i r 

P 2 --0 7 
c 2 - 2. 3 

i r 

P 3 * o 75 
c 3 = 3 4 

i r 

p 4 - 0 85 
c 4 = 4 5 



Figure 14 - System of four parallel subsystems connected in series - example problem 
Shading indicates redundant component. 


The problem is to determine the optimum values of x^ (i = 1, 2, 3, 4) such that 
C = 30, 45, and 60. The algorithm of Kettelle (ref. 3) was used to get the complete set 
of integer solutions for 0.90 < R ^ 0.999, which is shown in table XII. Those solu- 
tions generated by Everett's generalized Lagrange multiplier method (ref. 5) are noted 
in the table. 

The solutions shown in table XIII are the ones giving C closest to the specified 
values. The results of using equation (67) are shown in the same table for comparison. 
The approximation is very good. The complete set of solutions obtained by Kettelle’ s 
procedure (ref. 3) is shown in figure 15. Equation (67) is plotted to show the good 
agreement with the exact solutions. 

Similar agreement is evidenced when comparing the results of equation (83) with the 
exact solutions. The problem is to determine the optimum values of x. (i = 1, 2, 3, 4) 
such that R = 0.90, 0.99, and 0.999. The members of the complete family of integer 
solutions having reliabilities nearest these values are chosen for comparison. The re- 
sults are shown in table XIV . 

Table XV shows the comparisons of equations (83), (86), and (87) for the example 
problem. There is seen to be very little difference in the results obtained with the three 
equations. This agreement is better for the higher reliabilities, where the effect of the 
approximations used in deriving the equations is less pronounced. In general, equa- 
tion (86), derived in reference 10, is preferred because it produces an allocation having 
reliability closest to that specified in the first column of table XV. 
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1 minus system reliability, 


TABLE XIII - COMPARISON OF EQUATION (67) WITH OPTIMAL INTEGER 


SOLUTIONS - EXAMPLE PROBLEM 


Cost 

constraint 

Method 

— 

X 1 

X 2 

x 3 

x 4 

Reliability, 

R 

Cost. 

C 

30 

Optimum integer 

3 

3 

3 

2 

0. 9288 

29 70 


Equation (67) 

3.112 

3.378 

2.754 

2.030 

9346 

30.00 

45 

Optimum integer 

5 

5 

4 

3 

. 9900 

44 60 


Equation (67) 

4.358 

5 044 

4 200 

3. 087 

. 9910 

45 00 

60 

Optimum integer 

6 

6 

6 

4 

. 9985 

59. 40 


Equation (67) 

5 603 

6 709 

5 647 

4. 144 

9988 

60 00 



Figure 15 - Comparison of exact and approximate solutions - example problem 
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TABLE XIV. - COMPARISON OF EQUATION (83) WITH OPTIMAL INTEGER 


SOLUTIONS - EXAMPLE PROBLEM 


Reliability 

goal 

Method 

X 1 

X 2 

X 3 

x 4 

Reliability, 

R 

Cost, 

C 

0.900 

Optimum integer 

3 

4 

2 

2 

0. 9017 

28 60 


Equation (83) 

2.863 

3.046 

2.465 

1. 819 

. 9035 

27 01 

990 

Optimum integer 

5 

5 

4 

3 

. 9900 

44. 60 


Equation (83) 

4.294 

4.959 

4.126 

3 033 

. 9900 

44. 24 

.999 

Optimum integer 

6 

7 

6 

4 

. 9990 

61. 70 


Equation (83) 

5.725 

6.871 

5.787 

4.247 

. 9990 

61.46 


TABLE XV. - COMPARISON OF EQUATIONS (83), (86), AND (87) 
FOR EXAMPLE PROBLEM 


Reliability 

goal 

Equation 

X 1 

X 2 

x 3 

x 4 

Reliability. 

R 

Cost, 

C 

0.900 

(83) 

2.863 

3.046 

2.465 

1.819 

0. 9035 

27.01 


(86) 

2.834 

3.014 

2.440 

1.800 

. 9000 

26. 73 


(87) 

2.805 

2.982 

2.415 

1.782 

8964 

26. 45 

.990 

(83) 

4.294 

4.959 

4.126 

3.033 

. 9900 

44.24 


(86) 

4.291 

4.956 

4 124 

3.031 

. 9900 

44 21 


(87) 

4.288 

4.953 

4.121 

3.029 

.9900 

44. 18 

999 

(83) 

5 725 

6.871 

5.787 

4.247 

9990 

61.46 


(86) 

5.724 

6.871 

5 787 

4. 246 

.9990 

61. 45 


(87) 

5.724 

6.871 

5.787 

4.246 

. 9990 

61.45 


Concluding Remarks 

It has been show in this section that closed-form equations for approximating opti- 
mum redundancy in the series-parallel system can be derived by the use of Lagrange 
multipliers. These equations are used on the example problem of Kettelle (ref. 3) and 
result in good agreement. Only one of the equations is new, however; and it is show 
to be no better than the one developed by Moskowitz and McLean (ref. 10) using a varia- 
tional technique. The reason for presenting the two derivations is that for the first time 
equations for both maximum reliability for fixed cost and minimum cost for fixed relia- 
bility have been derived by the same technique, namely, the technique of Lagrange mul- 
tipliers. In addition, adjustment schemes are given to circumvent the approximations 
inherent in the development of the equations. The results are still approximate in that 
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they, in general, involve noninteger numbers of components. They do, however, form a 
convenient basis for exact solutions by the method of integer programming. 

In the search for optimal solutions, a reasonable question concerns the maximum 
reliability achievable for a fixed cost or the minimum cost achievable for a fixed relia- 
bility. The equations presented in this section allow rapid determination of those opti- 
mum conditions theoretically achievable with noninteger numbers of components. In this 
way a systems designer can determine whether a given design (arrangement of compo- 
nents) is near optimum and, hence, whether much could be gained by searching for the 
unique optimum design. 


CONCLUSIONS 

This analysis illustrates that the optimization of redundancy in the series-k-out-of-n 
system can be accomplished by appropriate use of some of the techniques used to solve 
similar problems for series-parallel systems. The two types of optimization problems 
considered herein are 

(1) Maximizing system reliability for the series-k-out-of-n system subject to mul- 

tiple cost constraints 

(2) Minimizing some function of the multiple cost factors for the series-k-out-of-n 

system subject to maintaining a minimum acceptable level of system reliability 

Five methods are presented for solving one or both of these problems without 
resorting to the inordinate expenditure of effort required in examining all possible com- 
binations of components. These five methods are 

(1) Kettelle's dynamic programming procedure as modified by Proschan and Bray 

to include multiple constraints 

(2) Everett's generalized Lagrange multiplier technique 

(3) The method of selecting consecutively for redundancy those subsystems which 

increase the reliability per unit of weighted costs by the greatest amount, 

which was used, for example, by Barlow and Proschan 

(4) Ghare and Taylor's formulation of the problem as a multidimensional knapsack 

problem using a branch-and -bound procedure 

(5) Mizukami’s combined concave and integer programming procedure 

These five methods are compared and an example problem is solved by the first three 
methods . 

Closed -form equations are derived by the use of Lagrange multipliers for the 
series-parallel system optimization problems of 

(1) Maximizing system reliability while maintaining a fixed single cost constraint 

(2) Minimizing a single cost while maintaining a fixed system reliability 
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The equations are no better than those already available , but they are derived by a 
method (Lagrange multipliers) that differs from the methods in the literature. The 
equations are used to solve an example problem, and on this basis a comparison is made 
with the equations cited from the literature. 

Lewis Research Center, 

National Aeronautics and Space Administration, 

Cleveland, Ohio, October 17, 1972, 

502-05. 
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APPENDIX A 


CONCAVITY CONDITIONS 

The conditions for concavity of the logarithm of reliability for a series-k-out-of-n 
system are developed herein. By equation (20) 


m 

In R = V In r i (20) 

i=l 


Since the logarithm of concave functions is concave and since the sum of concave func- 
tions in concave, the conditions need only be established for which r ; is a concave 

x 

function of n^ (i = 1, . . . , m) . For k-out-of-n subsystems, r^ is given by equation (8) as 



( 8 ) 


Concavity is satisfied by a negative value of 

A 2 r.( n .) = A [Ar i (n i )J i = 1 , . . . , m 


(Al) 


where, in general, 


Af(n) = f(n + 1) - f(n) 


(A 2) 


Expanding equation (Al) results in 


A r. 


i (n i ) = A r.(n. + 1) - r.(n.) 


i = 1. 


i m 


or 




r i (n i + 2) - 2r i (m + 1) + r^n.) i = 1, 


, m 


Now using equation (8) in equation (A 4) and simplifying yields 


(A 3) 


(A 4) 
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2 k i V k i +2 ' 1 + 1 

\\ - 1 , 


1 - 


n i" k i + 2 


q i (n i + 1) 


i = 1 , . . . , m 


(A 5) 


The concavity condition is satisfied when A li r(n i ) is negative, that is, when 


k. - 1 

n. > — 1 i = 1 , . . . , m 

Pi 


(A 6) 


In many cases this restriction results in smaller n- than the necessary condition 


n-a^ i = 1, — , 


m 


(A 7) 
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APPENDIX B 


CORRESPONDENCE BETWEEN PROBLEM I AND THE UNCONSTRAINED 

MAXIMIZATION PROBLEM 

The proof that the solution to Everett’s unconstrained maximization problem (ref. 5) 
is the solution to the constrained optimization problem is given herein. Everett's un- 
constrained problem is given by equation (21) as maximizing 

s 

H(n.) = In rjfoj) - ^ X.Cj.n. i = l,...,m (21) 

j=l 

The constrained optimization problem is given by equation (20) as problem I: Maximize 

m 

In R = In r. (20) 

i=l 


subject to 

m 

Z c..n. <C . i = 1 s 

lj i -j,max J ’ ’ 

i=l 

Let X = (X. , . . . , A ) be the set of nonnegative real numbers (not all zero) which 
yields n. (i = 1 , . . . , m) . Let n. ( X ) (i = 1 , . . . , m) designate the value of n^ which 
maximizes H(n.) for the chosen vector A. Since any other value of n. results in no 
greater value of H, 


H |n.(A) > H(n.) i = 1, . . . ,m 


(Bl) 


or 


s s 

In r i [n t (X )] - ^ X j c i j n i U ) ^ In r^m) - ^ A. cm i = 1 , . . . , m (B2) 

H 3=1 
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Rearranging equation (B2) yields 


m 

Summit; equation (B3) over all subsystems results in 


m 

m ^ 

s 

r m 



Z inr^tx)] 
i=l 

- Y ln r i (n i } + 

i=1 L 

) ■ x i|Z[ c ij n i a) - c ii n i] 

► 

(B4) 


j=l 


But the costs of any allocation cannot exceed 
j = l,...,s; so 


], max 


m 

= Yj where 

i=l 


m 

Y [ C ij n i^ ) ' C ij n i] ~ 0 3 = 1 . • • • . s ( B5 ) 

i=l 

Since all (j = 1, . . . , s) are nonnegative, equation (B4) can be written 
m m 

Y ^ r i[ n i(^)] - Y In r i (n i ) i = l,...,m (B6) 

i=l i=l 

Therefore, the m(A) (i = 1, . . . ,m) which maximizes equation (21) also is the value of 
m which maximizes equation (20) subject to the cost constraint 

c .j,max = c .j[ n i<*>] < B7 > 

And there is a one-to-one correspondence between problem I and the unconstrained 
maximization problem solvable by Everett's technique (ref. 5). 
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APPENDIX C 


DEVELOPMENT OF INTERCEPT FOR CONCAVE PROGRAMMING 

The intercept for the concave programming procedure is developed herein. As 
shown in figure 13, the slope of the line can be -written 

in r,(x. J - jij t 

x L—Lii hi i= l,...,m; t= l,...,h 

x - k 
x i,t K i 


(Cl) 


But X. . is also given by 

1 , L 


X. 


i.t 


In r 1 <x 1 t ) - In t-1 ) 


i = 1, . . . ,m; t = 1, . . . ,h 


(C2) 


x. . - x. . . 
i,t i,t-l 


Setting equation (Cl) equal to equation (C2) and solving for p. . results in 
(x m - k i> ln r i (x i.t-i> - < x i.t-i - k i> ln r i< x i,t ) 


"i.t 


X, . - X. , 1 

l.t l,t-l 


i = 1 , . . . , m; t = 1, . . . ,h 


(C3) 
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